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Congressional  Committees 

As  required  by  the  National  Defense  Authorization  Act  for  Fiscal  Year  1998 
(P.  L.  105-85),  we  reviewed  the  Air  Force’s  F-22  engineering  and 
manufacturing  development  (emd)  program.  This  report  presents  o\ir 
conclusions  regarding  whether  the  emd  program  is  likely  to  be  completed 
at  a  total  cost  that  does  not  exceed  the  cost  limitation  established  in  the 
act.  The  report  also  discusses  the  extent  to  which  the  cost,  schedule,  and 
performance  goals  for  the  F-22  emd  program  are  being  met  and  identifies 
contract  modifications  expected  to  have  a  significant  effect  on  cost  or 
performance  of  F-22  aircraft.  The  act  requires  us  to  certify  whether  we  had 
access  to  sufficient  information  to  make  judgments  on  the  matters  covered 
by  this  report. 


Background 


The  F-22  is  an  air  superiority  aircraft  with  the  capability  to  deliver 
air-to-ground  weapons.  The  most  significant  advanced  technology  features 
include  supercruise,  the  ability  to  fly  efficiently  at  supersonic  speeds 
without  using  fuel-consuming  afterburners;  low  observability  to  adversary 
systems;  and  integrated  avionics  to  significantly  improve  the  pilot’s 
situational  awareness. 

The  objectives  of  the  F-22  emd  program,  begun  in  1991,  are  to  (1)  design, 
fabricate,  test,  and  deliver  9  F-22  flight  test  vehicles,  2  ground  test  articles, 
and  26  flight  qualified  engines;  (2)  design,  fabricate,  integrate,  and  test  the 
avionics  suite;  and  (3)  design,  develop,  and  test  the  F-22  system  support 
and  training  systems. 

In  June  1996,  because  of  indications  of  potential  cost  growth  on  the  F-22 
program,  the  Assistant  Secretary  of  the  Air  Force  for  Acquisition  chartered 
a  Joint  Estimating  Team  (jet)  consisting  of  personnel  firom  the  Air  Force, 
the  Department  of  Defense  (dod),  and  private  industry.  The  objectives  of 
the  JET  were  to  estimate  the  most  probable  cost  of  the  F-22  program  and  to 
identify  realistic  initiatives  that  could  be  implemented  to  lower  program 
costs.  In  January  1997,  the  jet  estimated  the  F-22  emd  program  would  cost 
$18,688  billion,  an  increase  of  about  $1.45  billion^  over  the  previous  Air 
Force  estimate.  The  jet  also  reported  that  additional  time  would  be 


^JET  estimated  the  increase  at  $2.16  billion;  however,  a  decision  to  delete  preproduction  aircraft, 
estimated  to  cost  $0.71  billion,  reduced  the  estimated  increase  to  $1.45  billion. 
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required  to  complete  the  emd  program  and  recommended  changes  to  the 
EMD  schedule. 

The  Air  Force  and  Under  Secretary  of  Defense  for  Acquisition  and 
Technology  adopted  the  jet’s  recommendations,  including  its  cost 
estimate  for  the  emd  program.  Other  jet  recommendations  included 
slowing  the  manufacturing  of  the  emd  aircraft  to  ensure  an  efficient 
transition  from  development  to  low-rate  initial  production  and  increasing 
the  time  available  to  develop  and  integrate  avionics  software.^  In  August 
and  September  1997,  the  Air  Force  negotiated  changes  with  the  prime 
contractors^  to  more  closely  align  the  cost-plus-award-fee  contracts  with 
the  JET  cost  estimate  and  revised  schedule.  However,  as  of  January  1998, 
many  substantial  planned  changes  recommended  by  the  jet  had  not  been 
incorporated  into  the  Lockheed  Martin  contract,  such  as  changes  to  the 
avionics  estimated  to  cost  $221  million. 

The  National  Defense  Authorization  Act  for  Fiscal  Year  1998,  enacted  on 
November  18, 1997,  imposed  cost  limitations  of  $18,688  billion  on  the  F-22 
EMD  program  and  $43.4  billion  on  the  production  program.  The  limitation 
on  production  cost  did  not  specify  a  quantity  of  aircraft  to  be  procured. 
The  act  instructed  the  Secretary  of  the  Air  Force  to  adjust  the  cost 
limitations  for  (1)  the  amounts  of  increases  or  decreases  in  costs 
attributable  to  economic  inflation  after  September  30, 1997,  and  (2)  the 
amounts  of  increases  or  decreases  in  costs  attributable  to  compliance  with 
changes  in  federal,  state,  or  local  laws  enacted  after  September  30, 1997. 

Conferees  for  the  Department  of  Defense  Appropriations  Act,  1998, 
enacted  October  8, 1997,  provided  direction  to  the  Secretary  of  the  Air 
Force  regarding  out-of-production  parts  on  the  F-22  program.  Because  it  is 
not  economical  for  some  component  manufacturers  to  keep  production 
lines  open  to  produce  old  technology  parts  with  low  demand,  they  have 
discontinued  making  parts,  some  of  which  are  used  on  the  F-22  emd 
aircraft,  and  will  discontinue  making  others.  To  minimize  cost  and 
schedule  impacts  on  the  F-22  emd  and  production  programs,  the  Air  Force 
plans  to  redesign  these  out-of-production  parts  or  buy  sufficient  quantities 
of  them  for  the  first  five  lots  of  production  aircraft.  The  appropriations 
conferees  directed  the  Secretary  of  the  Air  Force  to  fund  the  cost  of 
redesigning  out-of-production  parts  from  the  Research,  Development,  Test 


^For  more  information  on  the  JET’s  recommendations  see  Tactical  Aircraft-  Restructuring  of  the  Air 
Force  F-22  Fighter  Program  (GAO/N8TAD-S7-]  56,  June  4, 1997). 

•■'The  m^or  prime  contractors  are  Lockheed  Martin  Aeronautical  Systems  for  the  mrcraft  and  United 
Technologies  Corporation  (Pratt  &  Whitney)  for  the  engines. 
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and  Evaluation  appropriation.  The  effect  of  following  that  direction  would 
be  to  add  that  effort,  expected  by  the  Air  Force  to  cost  $353  million,  to  the 
EMD  program. 

In  January  1998,  the  Air  Force  notified  the  Congress  that  it  increased  the 
EMD  cost  limitation  by  $353  million,  to  respond  to  direction  from  the 
conferees,  and  decreased  the  production  cost  limitation  by  the  same 
amount.  As  adjusted,  the  emd  cost  limitation  increased  to  $19,041  billion. 
In  addition,  the  Air  Force  plans  to  a^ust  the  cost  limitation  downward  by 
$102  million  to  $18,939  billion,  to  recognize  revisions  to  inflation 
assumptions  by  the  Office  of  the  Secretary  of  Defense. 


Results  in  Brief 


The  Air  Force’s  estimate  to  complete  F-22  emd  is  $18,884  billion, 

$55  million  less  than  the  emd  cost  limitation  that  will  be  adjusted  to 
$18,939  billion.  However,  the  F-22  emd  program  is  not  meeting  schedule 
goals  established  in  response  to  the  jet  review.  The  first  flight  of  the  F-22 
was  about  3  months  late,  issues  have  emerged  concerning  production  and 
delivery  of  wings  and  fuselages  for  the  emd  aircraft,  and  test  schedules 
have  consequently  been  delayed.  Lockheed  Martin  has  indicated  that 
negotiated  costs  should  not  be  exceeded  because  of  these  issues.  The  Air 
Force,  however,  is  further  assessing  the  impact  of  these  issues  on  emd 
cost,  the  schedule  upon  which  test  data  is  produced,  and  the  schedule 
upon  which  the  emd  program  is  to  be  completed.  The  Air  Force  expects  to 
complete  this  assessment  at  the  end  of  February  1998. 

The  Air  Force  is  estimating  that  the  F-22  will  meet  or  exceed  its 
performance  goals.  However,  less  flight  test  data  have  been  accumulated 
through  January  1998  than  were  expected  because  the  beginning  of  the 
flight  test  program  was  delayed  from  May  1997  to  September  1997  and 
flight  tests  have  been  suspended  to  accomplish  planned  ground  tests  and 
minor  structural  additions  to  the  airframe.  Flight  testing  will  not  resume 
until  April  1998.  Delayed  tests  reduce  the  amount  of  actual  F-22 
performance  information  that  will  be  available  to  support  Air  Force  plans 
to  begin  production  in  fiscal  year  1999. 

The  Air  Force  and  contractors  provided  us  access  to  sufficient  information 
to  make  informed  judgments  on  the  matters  covered  by  this  report.  This  is 
discussed  further  in  appendix  II. 
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Extent  to  Which  the 
F-22  Program  Is 
Meeting  the  Cost  Goal 
for  the  EMD  Program 


In  the  fiscal  year  1999  President’s  budget,  the  Air  Force’s  estimate  to 
complete  the  emd  program  was  $18,884  billion.  The  estimated  cost  to 
complete  emd  includes  the  negotiated  prices  of  the  major  prime  contracts, 
estimated  costs  of  significant  planned  contract  modifications,  other 
government  costs,  and  a  margin  to  accommodate  future  cost  growth. 

Although  contractor  reports  through  December  1997  project  that  the 
efforts  on  contract  are  expected  to  be  completed  within  the  negotiated 
contract  prices,  manufacturing  problems  with  the  wings  and  the  aft 
fuselage  could  change  those  projections  for  Lockheed  Martin. 


Estimated  Cost  of  EMD  The  Air  Force  contracts  with  Lockheed  Martin  and  Pratt  &  Whitney,  after 

being  restructured,  had  negotiated  prices  of  $16,003  billion.  The  Air  Force, 
as  of  December  1997,  planned  to  add  modifications  to  the  contracts 
totaling  about  $1,546  billion.  The  Air  Force’s  estimated  costs  for  F-22  emd 
are  shown  in  table  1. 


Table  1:  Air  Force  Estimated  Cost  of 
F-22  EMD 


Dollars  in  billions 

Element  of  cost 

Amount 

Lockheed  Martin  and  Pratt  &  Whitney 
contracts 

$16,003 

Planned  modifications  to  contracts 

1.546 

Other  government  costs 

1.184 

Margin  for  cost  growth 

0.151 

Total  costs 

$18,884 

Modifications  Planned  to 
EMD  Contracts 


Air  Force  officials  provided  us  a  list  of  planned  and  budgeted 
modifications  that  will  increase  the  contract  prices.  The  list  is  consistent 
with  the  JET  findings.  Modifications  planned  relate  to 

•  efforts  directed  by  the  conferees  on  the  Department  of  Defense 
Appropriations  Act,  1998,  to  redesign  out-of-production  parts 
($353  milhon); 

•  award  fees  to  be  paid  to  the  contractor  based  on  evaluations  of  contractor 
performance  ($262  million); 

•  extending  the  time  period  for  F-22  testing  ($230  million); 

•  addition  of  changes  (Block  IV)  to  the  avionics,  including  interface 
capability  with  the  newly  developed  AIM-9X  air-to-air  missile 
($221  million); 
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•  extending  the  time  period  for  keeping  an  active  laboratory  infrastructure 
($168  million); 

•  efforts  to  provide  the  capability  to  perform  air  combat  simulation  and 
ground  testing  of  avionics  prior  to  its  delivery  ($65  million); 

•  provision  for  contractor  resources  to  conduct  initial  operational  test  and 
evaluation  ($60  million); 

•  efforts  to  test  and  approve  the  F-22  for  supersonic  launch  of  external 
missiles  ($51  million); 

•  implementation  of  aircraft  battle  damage  repair  capability  ($29  million); 
and 

•  other  changes  ($117  million). 


Limited  Cost  Experience 
Indicates  Contract  Cost 
Goals  Are  Being  Met 


Since  the  contracts  were  restructured  in  August  and  September  1997, 
limited  experience  has  been  accumulated  to  indicate  the  extent  to  which 
contractors  are  completing  scheduled  work  at  the  planned  cost. 
Contractor  reports  reflecting  experience  through  December  1997, 
however,  indicate  the  contractors  are  predicting  they  will  be  able  to 
complete  efforts  now  covered  by  the  contract  within  the  negotiated  costs. 

Lockheed  Martin  and  Pratt  &  Whitney  report  to  the  Air  Force  monthly 
concerning  their  progress  compared  to  contract  costs  and  schedules. 
These  reports  define  the  cost  and  schedule  variances  from  the  contract 
plans.  When  the  contracts  were  restructured,  the  contractors  rebaselined 
their  cost  control  systems  that  measure  the  cost  and  schedule  progress 
and  calculate  how  the  actual  costs  and  schedules  vary  from  the  goals. 
Prior  to  restructuring  the  contracts,  the  Lockheed  Martin  and  Pratt  & 
Whitney  reports  indicated  unfavorable  variances  at  completion  of  bmd 
totaling  about  $1.2  billion. 

Both  Pratt  &  Whitney  and  Lockheed  Martin  reports  showed  variances  of 
less  than  1  percent  from  the  negotiated  contract  cost  and  plaimed 
schedule  through  December  1997.  The  most  significant  variance  identified 
in  the  contractor  reports  was  about  a  $54  million  imfavorable  schedule 
variance  for  Lockheed  Martin.  The  contractors’  reports  showed  that  the 
negotiated  costs  include  about  $194  million  for  management  reserves. 
Management  reserves  are  amounts  set  aside  to  react  to  cost  increases  due 
to  unplanned  efforts  or  cost  growth  in  planned  efforts.  Lockheed  Martin 
and  Pratt  &  Whitney  December  1997  reports  indicate  they  plan  to 
complete  the  contract  efforts  within  the  negotiated  costs.  However,  the 
impact  of  delays  in  the  delivery  of  wing  and  aft  fuselage  assemblies  and 
the  flight  test  program  have  not  been  reflected  in  those  reports.  Lockheed 
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Martin  has  advised  the  Air  Force  that  it  can  execute  the  revised  schedule 
caused  by  the  late  deliveries  at  no  increased  cost  to  the  emd  contract.  At 
the  time  of  our  review,  the  Air  Force  was  assessing  the  impact  of  these 
delays  and  whether  it  agrees  that  the  changes  can  be  accomplished  with 
no  cost  increase  to  the  emd  contract. 


Extent  to  Which  the 
F-22  Program  Is 
Meeting  the  Schedule 
Goals  for  the  EMD 
Program 


In  January  1998,  the  F-22  program  was  not  meeting  its  schedule  goals.  The 
first  flight  of  an  F-22  did  not  occur  on  time  and  resumption  of  its  flight  test 
program  will  be  delayed  by  at  least  2  to  3  weeks  to  correct  a  problem 
discovered  in  the  horizontal  tail  of  the  aircraft.  Also,  the  late  delivery  of  aft 
fuselage  assemblies  and  -wing  assemblies  is  expected  to  cause  delays  in 
delivery  of  other  emd  aircraft.  These  problems  will  also  delay  the  progress 
of  the  flight  test  program.  The  Air  Force  has  revised  its  schedule  to  reflect 
the  late  first  flight.  However,  it  had  not  determined  how  the  late  deliveries 
of  aft  fuselage  assemblies  and  wing  assemblies  will  impact  the  overall  F-22 
EMD  schedule.  The  Air  Force  planned  to  complete  its  evaluation  of  the 
impact  on  the  schedule  by  the  end  of  February  1998. 


First  F-22  Flight  Over 
3  Months  Late 


Because  of  a  number  of  technical  problems  with  the  aircraft,  the  first  flight 
of  the  first  F-22  emd  aircraft  was  delayed  over  3  months,  imtil  September  7, 
1997.  According  to  the  Air  Force,  the  problems  were  not  caused  by  the 
design  of  the  aircraft  but  involved  a  fuel  tank  leak,  failure  of  an  auxiliary 
power  unit  resulting  from  faulty  installation,  a  software  defect,  incorrect 
installation  of  the  electrical  connector  to  a  fuel  tank  probe,  and  foreign 
object  damage  from  debris  being  ingested  into  an  engine.  After  making 
two  flights,  the  aircraft  flight  test  program  was  suspended  to  accomplish 
planned  ground  tests  and  minor  structural  additions  to  the  airfirame. 
Resumption  of  the  flight  test  program,  planned  for  March  1998,  is  expected 
to  be  delayed  until  at  least  April  17, 1998,  because  materials  in  the 
horizontal  tail  of  the  aircraft  became  disbonded,  or  separated.  Air  Force 
officials  said  a  solution  to  this  problem  has  been  identified  and  it  will  not 
impact  other  emd  aircraft  schedules. 


Impact  of  Late  Aircraft 
Deliveries  on  Test  Plans  for 
Fiscal  Years  1998  and  1999 


The  flight  test  schedule  was  updated  in  May  1997  based  on  the  review  of 
the  program  by  the  jet,  with  first  flight  planned  to  occur  in  late  May  1997. 
However,  because  first  flight  did  not  occur  as  scheduled,  the  beginning  of 
the  flight  test  program  was  delayed.  Flight  tests  are  also  expected  to  be 
delayed  because  of  problems  with  manufacturing  wings  and  aft  fuselages 
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Wings  and  Aft  Fuselages 
Are  Expected  to  Be  Late 
for  Most  EMD  Aircraft 


and  expected  late  delivery  of  the  third  through  sixth  emd  flight  test 
aircraft. 

Because  of  the  delay  in  first  flight  and  expected  delays  in  delivery  of 
several  later  emd  aircraft,  a  number  of  flight  test  hours  planned  for  fiscal 
years  1998  and  1999  have  been  deferred  until  later  in  the  test  program. 
About  55  percent  (120  of  217  hours)  of  the  flight  test  hours  planned  for 
fiscal  year  1998  and  about  11  percent  (51  of  449  hours)  of  the  flight  test 
hours  planned  for  fiscal  year  1999  have  been  deferred  until  later  in  the  test 
program.  Although  test  hours  planned  for  the  early  stages  of  the  flight  test 
program  are  now  planned  to  be  accumulated  more  slowly,  Air  Force 
officials  said  the  total  number  of  flight  test  hours  planned,  the  number  of 
flight  test  months  planned,  and  the  completion  date  for  the  F-22  emd 
program  remain  about  the  same. 


Wing  deliveries  are  behind  schedule  because  of  problems  with  the 
development  and  manufacturing  of  large  titanium  wing  castings,  the 
foundation  upon  which  the  Aving  is  buUt.  As  of  January  1998,  the 
contractor  and  the  Air  Force  were  still  working  to  resolve  the  casting 
problem.  The  wings  for  the  next  four  flight  test  aircraft  and  the  two 
ground  test  articles  are  expected  to  be  delivered  about  2  weeks  to  over 
4  months  late  to  Lockheed  Martin. 

Delivery  of  the  F-22  aft  fuselage — the  rear  aircraft  body  section — is 
expected  to  be  late  for  the  next  four  flight  test  aircraft  and  the  two  ground 
test  articles  because  of  late  parts  deliveries  and  difficulties  with  the 
welding  process  caused  by  tight  tolerances  when  fitting  the  many  pieces  of 
the  fuselage  together.  An  Air  Force  and  contractor  team  has  been  formed 
to  evaluate  potential  cost,  schedule,  testing,  and  production  impacts 
associated  with  this  problem.  This  team  plans  to  complete  its  assessment 
by  the  end  of  February  1998. 

As  a  result  of  the  late  deliveries  of  the  wings  and  aft  fuselages,  the  first 
flights  of  the  third  through  the  sixth  emd  aircraft  are  expected  to  be  from 
about  2  weeks  to  over  5  months  late.  Air  Force  officials  said  first  flight  of 
the  second  emd  aircraft  is  expected  to  occur  on  schedule  because  the  time 
available  between  production  of  the  first  and  second  emd  aircraft  is 
expected  to  be  sufficient  to  allow  the  manufacturing  problems  to  be 
corrected.  Since  there  was  significantly  less  time  scheduled  between  the 
second  emd  aircraft  and  subsequent  emd  aircraft,  first  flight  of  later  emd 
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aircraft  will  be  delayed.  Table  2  compares  the  May  1997  scheduled  first 
flights  to  the  expected  dates  of  first  flights  as  of  January  1998. 


Table  2:  Comparison  of  Schedules  for 
First  Flights  of  EMD  Aircraft 

EWID  aircraft 

Scheduled  first 
flight  as  of  May 
1997 

Expected  first 
flight  as  of  January 
1998 

Months  of  delay  in 
first  flight 

4001 

May  29, 1997 

September  7, 1997® 

3.3 

4002 

July  9,  1998 

July  9.  1998 

0 

4003 

June  16,  1999 

November  22, 1999 

5.2 

4004 

August  17,  1999 

February  3,  2000 

5.6 

4005 

.  January  11,  2000 

March  31.  2000 

2.7 

4006 

May  18,  2000 

May  30,  2000 

0.4 

4007 

September  25,  2000  September  25,  2000 

0 

4008 

February  2,  2001 

February  2,  2001 

0 

4009 

June  1,  2001 

June  1, 2001 

0 

^Actual  date  of  first  flight. 

Extent  to  Which  the 
F-22  Program  Is 
Meeting  the 
Performance  Goals 
for  the  EMD  Program 


The  Air  Force  estimates  that  the  F-22  will  meet  or  exceed  the  goals  for  the 
major  performance  parameters.  These  include  10  parameters^  for  which 
the  Air  Force  reports  regularly  to  dod,  and  two  additional  performance 
features  gao  reviewed  that  relate  to  other  critical  characteristics  of  the 
F-22  aircraft.  The  Air  Force  estimates  how  performance  is  expected  to 
compare  to  specific  goals  for  each  parameter  by  estimating  and 
summarizing  the  performance  of  relevant  subparameters.  The  estimates 
are  engineering  judgments  based  on  computer  and  other  models,  tests  of 
some  components  in  flying  test  beds,  ground  tests,  analyses,  and,  to  a 
limited  extent,  flight  tests.  The  goal  for  each  parameter  is  based  on  the  emd 
contract  specifications.  Goals  for  the  many  subparameters  (about  160)  are 
established  to  ensure  that  the  goal  for  each  parameter  can  be  met. 


Although  the  Air  Force  has  not  included  them  in  the  10  parameters  for 
regular  reporting,  we  identified  and  reviewed  two  additional 
features — ^situational  awareness  and  low  observability — ^that  are  an 
integral  part  of  the  F-22  being  able  to  operate  as  intended.®  The  F-22 


^The  10  parameters  are  radar  cross  section  from  the  front  sector  of  the  aircraft,  supercruise, 
acceleration,  maneuverability,  payload,  combat  radius,  radar  detection  range,  airlift  support,  sortie 
generation  rate,  and  mean  time  between  maintenance. 

"Although  these  additional  features  are  not  official  performance  parameters,  the  Air  Force  does 
consider  them  critical  system  characteristics,  which  it  describes  as  generic  characteristics  that  do  not 
lend  themselves  as  well  to  measurement  and  reporting. 
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sensors,  advanced  aircraft  electronics,  and  cockpit  display  screens  are 
required  to  provide  the  pilot  improved  situational  awareness  of  potential 
enemy  threats  and  targets.  This  increased  awareness  is  to  improve  pilot 
response  time  to  the  threats,  thus  increasing  the  lethality  and  survivability 
of  the  aircraft.  The  aircraft’s  low  observable  or  “stealthy”  features  allow  it 
to  evade  detection  by  enemy  aircraft  and  surface-to-air  missiles.  We 
believe  the  situational  awareness  and  low  observability  features  are 
critical  to  the  success  of  the  F-22  program  and,  therefore,  we  reviewed 
them  and  are  reporting  on  the  Air  Force’s  progress  in  achieving  them 
along  with  the  10  parameters  the  Air  Force  established.  The  Air  Force’s 
10  parameters  and  the  2  additional  features  we  identified  and  reviewed  are 
described  in  appendix  I. 


As  of  January  1998,  the  Air  Force  estimated  that,  at  the  end  of  the  emd 
program,  the  F-22’s  performance  will  meet  or  exceed  the  goals  for  all 
10  established  parameters.  Table  3  shows  the  goal  (contract  specification) 
for  each  parameter;  the  estimated  performance  achieved  for  each 
parameter  based  on  computer  models,  analyses,  or  testing;  and  the  Air 
Force’s  current  estimate  of  the  performance  each  parameter  is  expected  to 
achieve  by  the  end  of  emd.  Most  of  the  goals  and  related  performance 
information  are  classified  and  are  therefore  shown  as  percentages  instead 
of  actual  numbers.  To  interpret  the  table,  it  is  constructed  so  that 
estimated  performance  greater  than  the  goal  is  better  than  the  goal,  except 
for  airlift  support  where  using  fewer  assets  is  better.  Table  3  also  shows 
the  two  additional  features  that  we  included  (situational  awareness  and 
aircraft  low  observability)  because  of  their  importance  to  the  success  of 
the  F-22  program. 
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Table  3:  Estimates  of  Performance  for 
Selected  Parameters  and  Additional 

GAO  Identified  Features 

Key  performance 
parameters 

Goai  (contract 
specification) 

Estimated 
performance 
achieved  to  date 

Air  Force  current 
estimate  at  EMD 
completion 

Supercruise 

100% 

114% 

114% 

Acceleration 

100% 

108% 

107% 

Maneuverability 

100% 

100% 

100% 

Airlift  support 
(C-141  equivalents) 

8 

7  to  9 

Less  than  8 

Sortie  generation  rate 

100% 

104% 

103% 

Radar  cross  section, 
front  sector  only 

100% 

Favorable 

Favorable 

Mean  time  between 
maintenance 

3.0  hours 

3.1  hours 

3.1  hours 

Payload  (missiles) 

6  medium-range 

2  short-range 

6  medium-range 

2  short-range 

6  medium-range 

2  short-range 

Combat  radius 

100% 

127% 

127% 

Radar  detection  range 

100% 

117% 

117% 

Additionai  features 
reviewed  by  GAO 

GoaP 

Estimated 
performance 
achieved  to  date 

Current  estimate  at 
EMD  completion 

Situational 

awareness 

100% 

Favorable 

Favorable 

Low  observability 

100% 

Favorable 

Favorable 

^These  goals  are  not  contract  specifications.  We  assigned  a  value  of  100%  to  evaluate  the 
features. 


Basis  for  Air  Force 
Estimates 


We  evaluated  the  basis  for  the  Air  Force’s  current  performance  estimates 
by  reviewing  and  analyzing  performance  information  and  estimates  for 
subparameters  that  are  the  components  of  each  parameter.  We  reviewed 
selected  analyses,  test  reports,  and  plans  the  Air  Force  used  to  formulate 
its  estimated  performance  achieved  to  date  and  projected  estimates  for  the 
end  of  EMD. 

As  of  January  1998,  estimated  performance  concerning  two 
subparameters,  aircraft  weight  and  fuel  usage,  was  not  expected  to 
achieve  goals  established  for  those  subpar2imeters.  However,  the  Air 
Force’s  analysis  indicates  that  failure  to  achieve  those  goals  will  not  cause 
the  associated  parameters  to  fail  to  meet  their  established  goals.  For 
example,  aircraft  empty  weight  is  a  subparameter  that  affects  the 
supercruise,  acceleration,  maneuverability,  and  combat  radius 
performance  parameters.  Although  the  aircraft’s  empty  weight  is  currently 
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expected  to  be  2  percent  higher  than  the  established  goal  for  that 
subparameter,  Air  Force  analyses  indicate  that  the  increased  weight  is  not 
significant  enough  to  cause  the  estimates  for  the  affected  parameters  to 
not  meet  their  goals.  A  more  extensive  discussion  of  our  analysis  and  a 
chart  listing  the  major  performance  subparameters  are  included  in 
appendix  II. 

Conclusion 

The  Air  Force’s  estimate  to  complete  F-22  emd  is  $18,884  billion, 

$55  million  less  than  the  emd  cost  limitation  that  will  be  adjusted  to 
$18,939  billion.  However,  issues  have  emerged  concerning  production  and 
delivery  of  wings  and  fuselages  for  the  emd  aircraft,  and  test  schedules 
have  consequently  been  delayed.  The  Air  Force  is  further  assessing  the 
impact  of  these  issues  on  emd  cost,  the  schedule  upon  which  test  data  is 
produced,  and  the  schedule  upon  which  the  emd  program  is  to  be 
completed. 

The  Air  Force  is  estimating  that  the  F-22  will  meet  or  exceed  its 
performance  goals.  However,  less  flight  test  data  have  been  accumulated 
through  January  1998  than  were  expected  because  the  flight  test  program 
was  delayed  and  flight  tests  have  been  suspended  to  accomplish  planned 
ground  tests  and  minor  structural  additions  to  the  test  aircraft  airframe. 
Delayed  tests  reduce  the  amount  of  actual  F-22  performance  information 
that  will  be  available  to  support  Air  Force  plans  to  begin  production  in 
fiscal  year  1999. 

Agency  Comments 

In  commenting  on  a  draft  of  this  report,  dod  generally  concurred  with  it 
and  advised  us  the  Air  Force  has  notified  the  Congress  about  changing  the 
EMD  and  production  cost  limitations  to  recognize  direction  from  the 
conferees  on  the  fiscal  year  1998  Defense  Appropriations  Act.  As  a  result 
of  this  additional  information,  we  have  removed  a  matter  for  congressional 
consideration  that  had  been  included  in  the  draft  report,  dod’s  comments 
are  included  in  appendix  III  to  this  report. 

We  performed  our  review  between  July  1997  and  February  1998  in 
accordance  with  generally  accepted  government  auditing  standards.  A 
description  of  our  objectives,  scope,  and  methodology  is  included  in 
appendix  II. 
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We  are  sending  copies  of  this  report  to  the  Secretaries  of  Defense  and  the 
Air  Force;  the  Director,  Office  of  Management  and  Budget;  and  other 
interested  parties. 

Please  contact  me  at  (202)  512-4841  if  you  or  your  staff  have  any  questions 
concerning  this  report.  Major  contributors  to  this  report  are  listed  in 
appendix  IV. 


Louis  J.  Rodrigue^ 

Director,  Defense  Acquisitions  Issues 
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List  of  Congressional  Committees 

The  Honorable  Strom  Thurmond 
Chairman 

The  Honorable  Carl  Levin 
Ranking  Minority  Member 
Committee  on  Armed  Services 
United  States  Senate 

The  Honorable  Ted  Stevens 
Chairman 

The  Honorable  Daniel  K.  Inouye 
Ranking  Minority  Member 
Subcommittee  on  Defense 
Committee  on  Appropriations 
United  States  Senate 

The  Honorable  Floyd  Spence 
Chairman 

The  Honorable  Ike  Skelton 
Ranking  Minority  Member 
Committee  on  National  Security 
House  of  Representatives 

The  Honorable  C.  W.  Bill  Young 
Chairman 

The  Honorable  John  P.  Murtha 
Ranking  Minority  Member 
Subcommittee  on  National  Security 
Committee  on  Appropriations 
House  of  Representatives 
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Supercruise 

Supercruise  means  the  aircraft  can  sustain  supersonic  or  mach^  speed 
without  using  its  afterbiurners.  Supercruise  saves  fuel  and  helps  reduce  the 
aircraft’s  infrared  signature  by  not  using  afterburners  that  produce  a  high 
infrared  signature.  A  reduced  infrared  signature,  in  turn,  helps  make  the 
F-22  low  observable  and  harder  for  enemy  aircraft  and  missiles  to  detect. 
The  measurement  used  for  supercruise  is  the  highest  mach  obtainable  in  a 
stable,  level  flight  at  40,000  feet  altitude. 

The  Air  Force  estimated  the  F-22  will  exceed  the  supercruise  goal  by 
about  14  percent.  This  estimate  was  determined  by  analysis  of  computer 
models  using  the  latest  data  available  on  aspects  such  as  the  engines’ 
thrust  and  fuel  flow  characteristics.  Propulsion  flight  testing  is  scheduled 
to  begin  in  the  first  quarter  of  1998  and  end  in  the  second  quarter  of  2000. 

Acceleration 

Acceleration  is  a  key  parameter  because  the  F-22  must  be  able  to  outrun 
enemy  aircraft  and  exit  an  area  after  it  employs  air-to-air  or  air-to-ground 
munitions.  The  acceleration  parameter  refers  to  the  amount  of  time  it 
takes  the  aircraft  to  go  from  0.8  mach  to  1.5  mach  at  30,000  feet  altitude. 

The  Air  Force  estimated  that  the  F-22  will  be  faster  than  the  acceleration 
goal.  This  estimate  was  determined  by  analysis  of  computer  models  and 
ground  test  data  using  the  latest  data  available  on  the  major 
subparameters  affecting  acceleration.  Propulsion  flight  testing  is 
scheduled  to  begin  in  the  first  quarter  of  1998  and  end  in  the  second 
quarter  of  2000  and  flight  performance  testing  is  scheduled  to  begin  in  the 
fourth  quarter  of  1998  and  end  in  the  third  quarter  of  2001. 

Maneuverability 

The  maneuverability  parameter  is  a  measurement  of  the  maximum  force 
the  aircraft  can  generate  during  a  turn  at  0.9  mach  at  30,000  feet  altitude 
without  losing  speed  or  altitude.  Many  additional  measures  that  relate  to 
the  maneuverability  of  an  aircraft  exist,  but  the  Air  Force  has  determined 
that  this  measurement  is  the  most  appropriate  to  demonstrate  the  general 
F-22  maneuverability  at  key  flight  conditions. 

The  Air  Force  estimated  the  F-22  will  meet  its  maneuverability  goal.  The 
Air  Force  estimate  was  determined  by  analysis  of  computer  models  using 
the  latest  data  available  on  the  major  subparameters  affecting 
maneuverability.  Flight  performance  testing  is  scheduled  to  begin  in  the 
fourth  quarter  of  1998  and  end  in  the  third  quarter  of  2001. 

^The  ratio  of  the  speed  of  the  aircraft  to  the  speed  of  sound,  which  is  about  738  miles  per  hour. 
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Airlift  Support  This  parameter  measures  the  number  of  C-141B  transport  aircraft 

equivalents  required  to  deploy  and  maintain  a  squadron  of  24  F-22  aircraft 
for  30  days  without  resupply.  The  goal  is  to  be  able  to  provide  this  support 
with  eight  C-141  equivalents,  thereby  reducing  the  assets  needed  to  deploy 
and  the  cost  of  deployment. 

The  Air  Force  estimated  it  will  require  less  than  eight  C-141  equivalents  to 
transport  a  squadron  of  24  F-22s.  This  estimate  was  based  on  a  recent 
study.  A  mobility  demonstration  to  verify  the  estimate,  which  cannot  be 
done  until  a  full  squadron  of  24  F-22  aircraft  is  activated,  is  scheduled  for 
2004  upon  delivery  of  the  24th  production  aircraft.  A  squadron  of  24  F-15s 
requires  19  C-141  equivalents. 


Sortie  Generation  Rate  Sortie  generation  rate  is  defined  as  the  average  number  of  sorties  or 

missions  flown  per  aircraft  per  day  for  the  first  6  days  of  a  potential 
conflict.  This  parameter  measures  the  degree  to  which  the  F-22  will  be 
available  during  the  first  few  days  of  a  potential  conflict  to  achieve  and 
maintain  air  superiority. 

The  Air  Force  estimated  the  F-22  will  exceed  the  sortie  generation  rate 
goal.  This  estimate  was  based  on  the  results  of  a  6-day  surge  analysis  done 
on  a  computer  model  using  many  statistics  such  as  maintenance 
characteristics,  support  equipment  and  resource  availability,  and  aircraft 
maintenance  policy.  F-22  maintainability  demonstrations  are  scheduled  to 
be  accomplished  by  2002  to  verify  the  sortie  generation  rate  estimates. 


Radar  Cross  Section  The  radar  cross  section  (rcs)  parameter  essentially  refers  to  how  large  the 

F-22  should  appear  to  enemy  radar.  The  smaller  an  aircraft’s  rcs,  the 
harder  it  is  for  enemy  radar  to  detect  and  track.  A  small  rcs,  along  with 
several  other  factors,^  contributes  to  an  aircraft’s  low  observability  or 
“stealthy”  nature.  This  particular  parameter  is  called  front  sector  rcs, 
which  means  it  is  the  rcs  when  the  F-22  is  viewed  from  the  front  by  enemy 
radar.  While  there  are  over  200  F-22  rcs  measurement  points,  the  Air  Force 
considers  the  front  sector  rcs  the  most  important  measure  of  the  aircraft’s 
ability  to  avoid  detection  by  an  enemy. 

The  Air  Force  estimated  the  F-22’s  front  sector  rcs  will  be  smaller  or 
better  than  its  goal.  Air  Force  rcs  estimates  were  based  on  component 


^Otiier  factors  contributing  to  an  aircraft’s  low  observability  include  low  (1)  infrared  signature, 
(2)  electromagnetic  signature,  (3)  acoustic  level,  and  (4)  visibility. 
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models  that  predict  the  Rcs  of  major  components,  such  as  engine  mlets 
and  wings,  and  then  use  this  data  to  predict  the  RCS  of  an  entire  aircraft. 
There  are  27  major  subparameters  of  this  rcs  parameter,  rcs  design 
validation  and  specification  compliance  are  also  being  conducted  with  a 
full-scale  F-22  mounted  on  a  pole  enabling  testers  to  take  rcs 
measurements.  This  testing  will  continue  into  1999.  In-flight  rcs 
measurements  will  begin  in  1999  and  continue  into  2002. 


Mean  Time  Between  Mean  time  between  maintenance  is  a  measure  of  aircraft  reliability  defined 

Maintenance  ^  number  of  aircraft  flight  hours  divided  by  the  total  number  of 

aircraft  maintenance  actions  in  the  same  period.  The  F-22  goal  is  3  flight 
hours  between  maintenance  actions  by  the  time  the  F-22  reaches  system 
maturity. 

The  Air  Force  estimated  that  by  the  time  the  F-22  reaches  system  maturity 
(100,000  flight  hours,  or  about  year  2008),  the  F-22  will  only  require 
maintenance  every  3.1  flight  hours.  A  reliability  computer  model  was  used 
to  develop  this  estimate  by  using  factors  like  the  design  of  systems  on  the 
aircraft  and  scheduled  maintenance  activities.  Throughout  development 
and  operational  flight  testing,  maintenance  data  is  to  be  collected  from  the 
500th  through  the  6,000th  hour  of  flight  testing  to  update  the  maintenance 
estimate.  Data  will  continue  to  be  collected  about  operational  usage  of  the 
aircraft  through  system  maturity  to  verify  requirements. 


Payload  The  payload  parameter  is  the  number  of  air-to-air  missiles,  medium  and 

short  range,  the  F-22  is  to  carry  when  conducting  an  air  superiority 
mission  and  not  attacking  enemy  ground  targets.  Payload  is  a  key 
parameter  because  the  F-22  is  designed  to  cany  missiles  in  its  internal 
weapons  bay,  not  externally.  Carrying  weapons  externally  increases  an 
aircraft’s  radar  cross  section  and  can  allow  easier  detection  by  enemy 
radar. 

The  Air  Force  estimated  that  the  F-22  will  meet  the  payload  goal  of 
carrying  six  AIM-120C  medium-range  missiles  and  two  AIM-9X  short-range 
missiles  internally.  Weapons  bay  testing  is  scheduled  for  mid-2000  to 
determine  how  well  the  missiles  can  exit  the  weapons  bay  when  launched. 


Combat  Radius  The  combat  radius  parameter  refers  to  the  nautical  miles  the  F-22  is 

required  to  fly  to  achieve  its  primary  mission  of  air  superiority.  This 
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mission  requires  the  F-22  to  be  able  to  fly  a  certain  distance  subsonically 
and  a  certain  distance  supersonically  to  achieve  the  mission. 

The  Air  Force  estimated  the  F-22  will  exceed  its  combat  radius  goal  by 
23  percent.  Unfavorable  estimates  for  two  of  three  major 
subparameters — ^fuel  usage  and  aircraft  weight — are  not  unfavorable 
enough  to  prevent  the  F-22  from  meeting  its  combat  radius  goal. 
Performance  flight  testing  to  help  compute  the  aircraft’s  combat  radius 
performance,  as  well  as  other  aerodynamic  capabilities,  is  scheduled  to 
begin  in  late  1998  and  end  the  third  quarter  of  2001. 


Radar  Detection  Range  The  radar  detection  range  parameter  refers  to  the  number  of  nautical 

miles  at  which  the  F-22  radar  should  be  able  to  detect  enemy  threats  or 
potential  targets.  The  radar  needs  to  be  able  to  detect  enemy  targets  with 
small  radar  signatures  at  sufficient  distance  to  ensure  the  F-22  can  engage 
the  enemy  first. 

The  Air  Force  estimated  that  the  F-22  radar  will  exceed  the  established 
radar  goal  by  17  percent.  This  estimate  was  based  primarily  on  digital 
simulations  and  models  used  to  develop  confidence  in  the  tactical 
functions  of  radar  search  and  detection  capabilities.  Radar  detection 
performance  is  scheduled  to  be  verified  against  the  simulations  and 
models  in  an  aviation  electronics  laboratory  from  the  first  quarter  of  1998 
to  the  third  quarter  of  1999.  Actual  flight  testing  of  the  radar  in  F-22  emd 
aircraft  is  scheduled  to  begin  in  the  third  quarter  of  1999  and  continue  to 
at  least  the  second  quarter  of  2001. 


Situational  Awareness  The  situational  awareness  parameter  refers  to  the  extent  the  F-22  sensors 

and  aviation  electronics  systems  are  able  to  make  pilots  aware  of  the 
situation  around  them.  The  planned  integration  of  the  many  aviation 
electronics  systems  and  sensors  is  meant  to  (1)  minimize  pilot  workload  of 
managing  and  interpreting  sensors  and  (2)  provide  previously  unmatched 
awareness  of  potential  F-22  threats  and  targets. 

Air  Force  data  indicated  the  F-22  will  meet  the  pilot  situational  awareness 
goal  based  on  its  performance  estimates  of  the  major  aviation  electronics 
subparameters  affecting  situational  awareness  including  the  radar  system, 
the  electronic  warfare  systems,  and  the  communications,  navigation,  and 
identification  systems.  Sixty-three  major  aviation  electronics  functions 
contribute  to  these  three  major  subparameters. 


Page  19 


GAO/NSIAD-98-67  F-22  Development  Program 


Appendix  1 

Description  of  F-22  Performance 
Parameters 


Development  of  the  integrated  aviation  electronics,  however,  is  in  the 
early  stages.  For  example,  the  Air  Force  provided  us  information  on 
10  major  milestones  that  must  be  completed  before  integrated  avionics 
development  will  be  complete  and  the  first  milestone  is  not  scheduled 
until  October  1998.  The  last  of  these  milestones  is  scheduled  for 
November  2001. 


Low  Observability  The  low  observability  parameter  refers  to  the  aircraft’s  “stealthy"  nature  or 

ability  to  evade  detection  by  enemy  radar  long  enough  for  it  to  detect  the 
enemy  and  shoot  first.  Five  features  of  an  aircraft  contribute  to  its  degree 
of  low  observability  or  “stealthiness”  including  radar  cross  section, 
infrared  signature,  electromagnetic  signature,  visual  signature,  and 
acoustic  signature.  However,  the  F-22  does  not  have  a  requirement  for  an 
acoustic  signature. 

Air  Force  information  indicated  it  expects  the  F-22  to  meet  the 
performance  goals  established  for  the  various  aspects  of  low  observability. 
Specification  compliance  on  the  most  critical  feature,  radar  cross  section, 
is  being  checked  with  a  full-scale  F-22  mounted  on  a  pole  and  will 
continue  into  1999.  In-flight  radar  cross  section  measurements  will  begin 
in  1999  and  continue  into  2002.  Flight  testing  to  help  predict  the  F-22 
infrared  signature,  another  critical  aspect  of  low  observability,  is 
scheduled  for  the  third  quarter  of  1999. 
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Our  objective  was  to  determine  whether  the  F-22  emd  program  can  be 
completed  within  the  cost  limitation  established  by  the  Congress.  We  also 
reviewed  the  extent  to  which  the  F-22  emd  program  was  achieving  cost, 
schedule,  and  performance  goals,  including  major  modifications. 

To  determine  whether  the  program  was  expected  to  meet  the  cost 
limitation,  we  obtained  the  current  cost  estimate,  which  served  as  a  basis 
for  the  fiscal  year  1999  budget  request.  We  compared  that  estimate  to  the 
estimate  supporting  the  cost  limitation  and  discussed  the  reasons  for  the 
differences  with  F-22  financial  management  officials.  We  made  several 
analyses,  including  comparing  the  estimated  cost  at  completion  for  the 
prime  contracts  with  planned  amounts,  and  evaluating  cost  variances 
identified  in  the  earned  value  management  system. 

We  obtained  and  reviewed  information  on  the  cost  and  schedule  goals  for 
the  F-22  EMD  program  established  by  the  jet  during  its  review  of  the  F-22 
program.  Since  the  jet  did  not  revise  F-22  performance  requirements,  we 
defined  the  performance  goals  as  those  performance  requirements  on 
contract  at  the  time  the  jet  reviewed  the  program.  To  assist  us  in 
determining  the  goals,  we  also  reviewed  overall  program  documents  such 
as  Selected  Acquisition  Reports,  Monthly  Acquisition  Reports,  Defense 
Acquisition  Executive  Summaries,  Program  Management  Reviews, 
contracts  with  the  prime  contractors.  Test  and  Evaluation  Master  Plans, 
and  Program  Management  Directives. 

To  determine  whether  the  program  was  expected  to  meet  schedule  goals, 
we  obtained  the  current  approved  program  schedule,  which  incorporated 
the  latest  restructured  plans  for  the  F-22  emd  program.  We  discussed  the 
schedule  and  potential  changes  to  it  with  F-22  program  officials.  We  also 
reviewed  the  planned  flight  test  schedule  and  the  changes  to  it  as  a  result 
of  the  late  first  flight  of  the  first  emd  aircraft.  In  addition,  we  discussed 
technical  problems  in  assembling  subsequent  emd  aircraft.  We  evaluated 
schedule  variances  in  the  earned  value  management  system  and  compared 
planned  milestone  accomplishment  dates  with  actual  dates  of 
accomplishments.  We  also  assessed  the  impact  the  late  first  flight  may 
have  on  the  overall  emd  schedule. 

To  determine  whether  the  program  was  expected  to  meet  the  F-22 
performance  goals,  we  analyzed  information  on  the  performance  of  key 
performance  parameters  and  of  those  important  subparameters  that  are 
measured.  We  compared  the  Air  Force’s  current  estimate  for  these 
parameters  to  previous  estimates  to  determine  whether  estimated 


Page  21 


GAO/NSIAD-98'67  F-22  Development  Program 


Appendix  II 

Objectives,  Scope,  and  Methodology 


performance  had  changed.  We  determined  whether  the  current  estimates 
were  based  on  actual  tests,  engineering  models,  or  engineering  judgment. 
We  discussed  each  of  the  key  performance  parameters  with  program 
officials  and  determined  the  basis  for  the  current  estimates.  We  also 
reviewed  past  program  documentation  to  determine  the  basis  for  the 
required  performance  and  discussed  the  reasons  for  differences  between 
required  performance  and  estimated  performance. 

To  evaluate  the  bases  for  the  Air  Force’s  current  performance  estimates, 
we  collected  information  on  the  goals  established  for  the  major 
performance  subparameters  that  are  critical  components  of  the 
performance  parameters.  We  collected  and  analyzed  information  on  Air 
Force  estimates,  as  of  January  1998,  toward  meeting  the  goals  of  these 
subparameters  to  determine  whether  the  Air  Force  estimates  seemed 
reasonable.  For  example,  the  major  subparameters  of  the  airlift  support 
parameter  are  the  number  of  aircraft  support  equipment  items,  the  airlift 
loads  necessary  to  transport  aircraft  support  equipment  items,  and  the 
maintenance  manpower  required  for  a  squadron  of  F-22s.  Each  of  these 
subparameters  has  a  performance  goal  just  as  the  overall  parameter  has  a 
performance  goal.  The  performance  parameters  and  their  associated 
major  subparameters  are  shown  in  table  ILL 
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Table  11.1:  List  of  F-22  Performance 
Parameters  and  Critical 

Performance  parameter 

Major  subparameter 

Subparameters 

Supercruise 

Engine  thrust 

Acceleration 

Aircraft  weight 

Maneuverability 

Airframe  drag 

Airlift  support 

Number  of  support  equipment  items 

Airlift  loads  required  to  deploy  support 
equipment 

Maintenance  manpower  required 

Sortie  generation  rate  Mean  time  between  maintenance 


Maintenance  manhours/flying  hour 


Number  of  support  equipment  items 
Maintenance  manpower  required 


Radar  cross  section 

(27  individual  subparameters) 

Meantime  between  maintenance 

Airframe 

Avionics 

Engines 

Payload 

(No  subparameters) 

Combat  radius 

Fuel  usage 

Aircraft  weight 

Airframe  drag 

Radar  detection  range 

Range  in  searching  for  targets 

Range  in  searching  for  targets  by  tracking 
target  speed 

Time  taken  to  search  for  targets 

Time  taken  to  search  for  targets  by 
tracking  target  speed 

Additional  features  identified  by  GAO 

Major  subparameter 

Situational  awareness 

Radar  function 

Electronic  warfare  function 

Communication,  navigation,  identification 
function 

Low  observability 

Infrared  signature 

Electromagnetic  emissions  signature 

Visual  signature 

Radar  cross  section 
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To  determine  the  status  of  contract  modifications  expected  to  have  a 
significant  effect  on  F-22  cost  or  performance,  we  reviewed  the  Air  Force’s 
process  for  receiving,  reviewing,  approving,  and  monitoring  engineering 
change  proposals.  We  obtained  a  list  of  the  proposals  received  and 
determined  which  had  been  approved.  For  those  proposals  that  were 
approved,  we  reviewed  the  related  documentation  to  determine  their 
status  and  their  estimated  impact  on  aircraft  performance  and  on  the  cost 
of  the  EMD  program. 

To  be  able  to  certify  whether  we  had  access  to  sufficient  data  to  make 
informed  judgments  on  the  matters  covered  in  our  report,  we  maintained  a 
log  of  our  requests  and  the  Air  Force  responses.  We  numbered  and  tracked 
each  request  we  made  for  documents  and  for  meetings  to  determine  how 
long  it  took  to  receive  responses  from  the  Air  Force.  As  a  result  of  this 
tracking,  we  were  able  to  certify  that  we  had  access  to  sufficient 
information  to  make  informed  Judgements  on  the  cost,  schedule,  and 
performance  matters  covered  in  this  report. 
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Note:  GAO  comments 
supplementing  those  in  the 
report  text  appear  at  the 
end  of  this  appendix. 


OFFICE  OF  THE  UNDER  SECRETARY  OF  DEFENSE 

3000  DEFENSE  PENTAGON 
WASHINGTON.  DC  20301*3000 


ACCUISITiCN  ANC5 
TECHNOLOGY 

Mr.  Louis  J.  Rodrigues 
Director,  Defense  Acquisition  Issues 
National  Security  and  International 
Affairs  Division 

U.S.  General  Accounting  Office 
Washington,  D.C.  20548 


1 2  FEB  m 


Dear  Mr.  RodriguesY: 

This  is  the  Department  of  Defense  (DoD)  response  to  the  General  Accounting  Office  (GAO) 
Draft  Report,  **F-22  AIRCRAFT:  Progress  in  Achieving  Engineering  and  Manufacturing 
Development  Goals,”  dated  January  16,  1998  (GAO  Code  707275),  OSD  Case  1521. 

Section  217  of  the  Jsiational  Defense  Authorization  Act  for  FY199S  included  language  that 
capped  the  cost  of  the  Engineering  and  Manufacturing  Development  (E&MD)  for  the  F-22  at 
$18,688  billion,  and  the  production  program  cost  at  $43.4  billion.  The  statute  permits  these  numbers 
to  be  adjusted  for  (1)  increases/decreases  in  economic  inflation  after  September  30,  1997,  and  (2) 
increases/decreases  in  cost  attributable  to  compliance  with  changes  in  federal,  state,  or  local  laws 
enacted  after  September  30, 1997.  The  Defense  Appropriations  Act  for  Fiscal  Year  1998  transferred 
$73  million  of  FY  1997  Air  Force  .4ircrafl  Procurement  to  Air  Force  RDT&E.  .Additionally,  the 
congressional  direction  contained  in  the  House  Appropriations  Committee  Report,  agreed  to  in  the 
Conference  Report,  states  that  OuFof-Produciion  Parts  should  be  budgeted  in  RDT&E  in  future 
budgets. 

These  transfers  in  funding  for  out-of-production  parts  from  Air  Force  Aircraft  Procurement 
to  Air  Force  RDT&E  required  an  increase  to  the  cap  on  E&MD,  and  a  reduction  to  production  cost 
by  a  like  amount.  Accordingly,  pursuant  to  the  adjustment  of  limitation  provisions  of  Section  217, 
the  Secretary  of  the  Air  Force  has  adjusted  the  E&MD  cap  upward  by  $353  million,  and  the  cap  on 
production  downward  by  the  same  amount. 

The  attachment  addresses  the  specific  GAO  matters  in  more  detail.  Also,  we  have  separately 
provided  a  number  of  changes  that  the  Department  feels  are  important  to  correct  errors  in  factual 
accuracy.  The  Department  appreciates  the  opportunity  to  comment  on  the  draft  report. 


George  R.  Schneiter 
Director 

Strategic  and  Tactical  Systems 


Attachment 


o 
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GAO  DR.AJT  REPORT  DATED  JANUARY  16, 1998 
(GAO  CODE  707275),  OSD  CASE  1521 

‘T-22  AIRCRAFT:  Progress  in  Achieving  Engineering  and  Manufacturing  DevelopEnent 

Goals’’ 

DEPARTMENT  OF  DEFENSE  COMMENTS 

MATTERS  FOR  CONGRESSIONAL  CONSIDERATION 

Matter  1:  The  GAO  asserted  that  although  there  are  many  uncertainties  about  the  likely 

schedule  and  cost  of  the  Engineering  and  Manufacturing  Development  (E&MD)  program,  it 
appears  based  on  curreni  Air  Force  projections,  including  the  amounts  estimated  to  be  needed  to 
comply  with  the  Appropriations  conferees’  direction  concerning  redesign  of  out-of-production 
parts,  that  the  F-22  E&MD  program  cost  could  exceed  the  statutory'  limitalton.  Consequently, 
the  GAO  suggested  that  the  Congress  may  wish  to  consider  changing  the  E&MD  cost  limitation 
by  an  amount  sufficient  to  comply  with  the  .conferees*  direction  concerning  the  out-of- production 
See  comment  1 .  parts,  (p.  20/GAO  Draft  Report)  ’ 

DoD  Response:  Partially  Concur.  The  E&MD  cost  limitation  of  $  1 8.688  billion  required 

an  upward  adjustment  of  S353  million  to  reflect  direction  contained  in  the  FYi998  Defense 
Appropriations  Act.  Conferees  directed  the  Secretary'  of  the  Air  Force  to  fund  oui-of-production 
part  redesigns  initiated  prior  to  production  contract  award  w'ith  RDT&E  funding.  In  support  of 
that  direction,  the  conferees  transferred  FY 1997/98  production  funding  to  RDT&E  funding  for 
out-of-production  part  redesigns.  Because  the  Secretary  of  the  Air  Force  has  adjusted  the 
limitations  under  the  adjustment  of  limitations  provision  of  Section  217  of  the  National  Defense 
Authorization  Act  for  FY199S,  congressional  action  is  not  required. 

Matter  2:  The  GAO  also  suggested  that  the  Congress  may  wash  to  consider  an  adjustment  to 

See  COmiTient  1 .  the  production  cost  limitation,  (p.  20/GAO  Draft  Repon.) 

DoD  Response:  Partially  Concur.  The  production  cost  limitation  of  S43.4  billion 

required  a  dow'nward  adjustment  of  $353  million  to  reflect  direction  contained  in  the  FY199S 
Defense  Appropriations  Act.  Conferees  directed  the  Secretary  of  the  Air  Force  to  fund  out-of- 
production  part  redesigns  initiated  prior  to  production  contract  award  with  RDT&E  funding. 

Since  the  $43.4  billion  production  cost  estimate  reflects  the  out-of-production  redesign  effort  as 
production  funded,  and  the  conferees  directed  the  use  of  RDT&E  funding,  a  dov,>nw'ard 
adjustment  to  Ihe  production  cost  limitation  was  required.  Because  the  Secretary  of  the  .Air  Force 
has  adjusted  the  limitations  under  the  adjustment  of  limitations  provision  of  Section  2 17  of  the 
National  Defense  Authorization  Act  for  FY  1998,  congressional  action  is  not  required. 
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GAO  Comment 


The  following  is  gao’s  comment  on  the  Department  of  Defense’s  letter 
dated  February  12,  1998. 


1.  Our  draft  report  was  submitted  to  dod  for  comment  at  about  the  same 
time  as  the  Air  Force  notified  the  Congress  that  the  bmd  cost  limitation 
was  being  increased  and  the  production  cost  limitation  was  being 
decreased  to  recognize  direction  from  the  conferees  on  the  Department  of 
Defense  Appropriations  Act,  1998.  Although  direction  from  the  conferees 
is  technically  not  a  change  in  federal,  state,  or  local  law  defined  as  a 
criteria  for  changing  the  cost  limitations,  we  believe  the  intent  of  the 
conferees’  direction  is  clear  and  that  the  types  of  ac^ustments  the  Air 
Force  made  to  the  cost  limitations  are  appropriate. 
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The  first  copy  of  each  GAO  report  and  testimony  is  free. 
Additional  copies  are  $2  each.  Orders  should  be  sent  to  the 
following  address,  accompanied  by  a  check  or  money  order 
made  out  to  the  Superintendent  of  Documents,  when 
necessary.  VISA  and  MasterCard  credit  cards  are  accepted,  cdso. 
Orders  for  100  or  more  copies  to  be  mailed  to  a  single  address 
are  discounted  25  percent. 

Orders  by  mail: 

U.S.  General  Accounting  Office 
P.O.  Box  37050 
Washington,  DC  20013 

or  visit: 

Room  1100 

700  4th  St.  NW  (corner  of  4th  and  G  Sts.  NW) 

U.S.  General  Accounting  Office 
Washington,  DC 

Orders  may  also  be  placed  by  calling  (202)  512-6000 

or  by  using  fax  number  (202)  512-6061,  or  TDD  (202)  512-2537. 

Each  day,  GAO  issues  a  list  of  newly  available  reports  and 
testimony.  To  receive  facsimile  copies  of  the  daily  list  or  any 
list  from  the  past  30  days,  please  call  (202)  512-6000  using  a 
touchtone  phone.  A  recorded  menu  will  provide  information  on 
how  to  obtain  these  lists. 

For  information  on  how  to  access  GAO  reports  on  the  INTERNET, 
send  an  e-mail  message  with  "info"  in  the  body  to: 

info@www.gao.gov 

or  visit  GAO’s  World  Wide  W^eb  Home  Page  at: 
http://www.gao.gov 
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